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Investigative Data Warehouse ODW) Virtual Knowledge Base rVKR^ 
Full Privacy Impact Assessment. MIOG 16-21 


Executive Summary 


This full Privacy Impact Assessment (PIA) is submitted by the Information Resources Division 
in accordance with MIOG 16-21.3, Completing a Privacy Impact Assessment, and MIOG 16- 
21.5, Paragraphs A, B, C, and D. This assessment is intended to address MIOG requirements for 
the enterprise Investigative Data Warehouse (IDW) and Virtual Knowledge Base (VKB), and is 
submitted in coordination with Office of General Coimsel for approval. 
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From: 

Sent: 

To: 

Cc: 

Subject: 


J (OGC) (FBI) 


C 


nOGC) (FBI) 


Wednesday, August 30, 2006 12:49 PM 
KELLEY. PATRICK W. (OGC) (FB h 
I t^UZIlOGC) (FBI)| 

pGC) (FBI) ’ 


](OGC) (FBI)C 


■TDW PIAs 


be 

b7C 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 



ALL lUFQRHATIQN COWTAIHED 

HEREIH IS UNCLASSIFIED 

DATE 08-28-2007 BY 65179 dmh/bja/cal 


scopelpia.wpd (24 
KB) 



[DW2.pia.wpd (206 
KB) 



SARS database In IDW.SPT.wpd (229 
IDW.wpd (30 K... KB) 



ISPG approval IDW 
data sets2.w... 



FirCEN data for 
IDW.txt (6 KB)... 


1 







-c 

RE National 
jecurity Determina.. 



b7D 


THIS IS A PRIVILEGED COMMUNICATION AND IS NOT TO BE FURTHER DISSEMINATED WITHOUT PRIOR 
OGC APPROVAL. 


SENSITIVE BUT UNCLASSIFIED 


2 







JOGC) (FBI) 
p. 2006 12:25 PM 

I (OGC) (FBI): KELLEY, PATRICK W. (OGC) (FBI) 
lystem 


UNCLASSIFIED b6 

NON-RECORD b7c 

i^A/ ^ a call frorri bt JMD about the article. Her Boss wanted to know which system notice covered 

IDW. I told her it is covered by CRS. Also explained that national security systems are exempt from E-Gov and that we 
had done several PIA looks at IDW, even though it's not required under the law. 


Original j 

From: 

Sent: 

To: 

Cc: 

Subject: 


lOGQ (FBI) 

weanesday, August JO, 2006 12:18 PM 
KELLEY. PATRICK W. (OGO (FBI) 
l (OGC) (FBI) 

RE: Central Record System 


UNCLASSIFIED 

NON-RECORD 


ALL IHFORJIATIOIJ CONTAIHED 

HEREIH IS UNCLASSIFIED 

DATE 08-28-2007 BY 65179 dmh/bja/cal 


Done. (Hope springs eternal.) 

I'm witl-j I in view that if everyone < I starts running around with their hair on fire on this, they will just 

be pounng gas on something that quite possibly would just fade away if we just shrug it off. 

Ofiginai Message 

From: KaLEY, PATRICK W. (OGC) (FBI) 

Sent- Wednesday. August 30. 2006 11-29 am ,b6 

!«• Ir— J(0GC)(FB1) b7C 

Cc: I f OGC) (FBI) 

Subject: Central Record System 

UNCLASSIFIED 

NON-RECORD 


Bill; can you send | | an electronic copy of the CRS Privacy Act System Notice. She is making noises about it 
I m hoping that after she reads it, she will be mollified. Thanks. 


UNCLASSIFIED 


UNCLASSIFIED 


UNCLASSIFIED 
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c 


(OGC) (FBI) 


From: 

Sent: 

To: 

Cc: 

Subject: 


J OGC) (FBI) 
Thursday, September 07, 2006 8:32 AM 

I FV P ATRir^KW (OGC) (FBI) 

l OGC) (FBI);| 

J (OGC) (FBI) 


(OGC) (FBI)I 


FW: IDW PIAs 


be 

b7C 


ALL IHFOFaiATIOH COHTAIKED 

SENSITIVE BUT UNCLASSIFIED HEREIU IS UNCLASSIFIED 

NON-RECORD DATE 03 - 28-2007 BY 6 S 179 dmli/bja/cai 

1058805 


be 

THIS IS A PRIVILEGED COMMUNICATION AND IS NOT TO BE FURTHER DISSEMINATED WITHOUT 
PRIOR OGC APPROVAL. 


— Original Message- 

From: 

Sent: 

To: 

Cc: 

Subject: 


GRIGG, G. CUVYTON (CTD) (FBI) 


Wprinpsflav-Spnipmhw- flfi 2006 6:20 PM 
lOGC) fFBnl 

IfirsmcFBi) 


DGC) (FBI] 

(CTD) (Fbl) ^ * 

(OGC) (FBI); 



kOGC) (FBI); HARRINGTON, T. I. 


be 

b7C 


RE; IDW PIAs 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 

b 5 


G. Clayton Grigg 


1 



Acting Director 

Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Division (CTD) 
http://ctd. fbinet. fbi/ftttf/ 

(703) 5531 ttffice) 

( 202)1 

(877)1 

i ~lfbi.aov (Blackberry UNCLASS) 


be 

b7C 

b2 


— Original 

From: 

Sent: 

To: 

Cc: 

Subject: 


Message — 


t OGC) (FBI) 

Wednesday, Septembe r 06, 2006 2:53 PM 

InSDVFBrv ORTry; n ri ayton n 


RE: 1I5W PlAs 


JOGC) (FBI){_ 


(FBI) 
OGC) (FBI)f 


po) 

loGC 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


JOGC) (FBI) 


be 

b7C 



— Original Message — 

From: I i rTTSPVFRTr 

Sent: Werinealav. Senlpmlw 06 , 2006 8:48 AM 

To: I l(OGC) (FB!)! 

Subjectf Kb: iUW PlAi ' 

SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


JOGQ(FBI) 


be 

b7C 


Thank you for taking care of this matter in my absence. 


^202 1 r 

1-8771 [P) 

Public Internet e-mail I 


gic.fbi.gov 


Original M 

From: 

Sent: 


es» 


OGQ (FBI) 


Thursday, August 31, 2006 3:54 PM 


l OGC) (FBI); GRIGG, G. CLAYTON (CTD) fFBnf 
(OGC) (FBD l I fQGQ (FBI)r^ 

/'PRT\* A7MT 7AI MAT /CDT\ 


Subject: 


(ITSD) (FBI); AZMI, 2ALMAI (DO) (FBI) 
RE: IDW PIAs 


l(rrSD)(FBI); KELLEY, PATRICK W. 
lOGQ (FBI); ISRAEL, JEROME W. 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


be 

b7C 

b2 



b5 
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- — Original Mes sage 


■From; | jOGC) (FBI) 

Sent Wednesday, Augu st 30. 2006 4:35 PM 

To: GRIGG, G. CUYTON (CTD ) (FBl)l t irSDi rFBDf 

(OGC) (FBI) i r OGO (FBI)|^ 

tOT\ 


Subject: 


(ITSD) (FBI); AZMI, ZALMAI (DO) (FBI) 
IDWPIAs 


(OGC) (FBI); KELLEY, PATRICK W. 
](OGQ (FBI); ISRAEL, JEROME W. 


be 

b7C 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


b5 


THIS IS A PRIVILEGED COMMUNICATION AND IS NOT TO BE FURTHER 

DISSEMINATED WITHOUT PRIOR OGC APPROVAL. 


SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
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(Rev, 01-31-2003) 


FEDERAL BUREAU OF INVESTIGATION 


Precedence: ROUTINE 

To: Office of the CIO 

Counterterrorism 

Records Management 


Attn: 


Attn: 


Attn: 


Date: 03/25/2005 

CIO Zalmai Azmi 


AD Willie T. Hulon 
DAD Donald N. Van Duyn 
DAD T . J . Harrington 
A/U G. Clayton Grigg 
AD William L. Hoot on 


From: Directorate of Intelligence 

Intelligence Issues Gr oup/lB2fiR 


Contact : SSA 


V202-324 


Approved By: Baginski Maureen A 

Solomon Jonathan I 


Drafted By: 


be 
b7C 
b2 

ALL INFORHATIOM COHTAIHED 

HEKEIM IS UNCLASSIFIED 

DATE 08-28-2007 BY 65179 dmli/b ja/cal 


Case ID #: 66F-HQ-C1434337 (Pending) 

Title: ISPG APPROVAL OF REQUEST FOR 

INCLUSION OF ADDITIONAL DATA SETS 
IN IDW/SPT 

S^opsis: The Inf oration Sharing Policy Group (ISPG) approves 

n sets for inclusion 

Projects Team (SPT) accesses of the Investigative 
(IDW) . This data will support ongoing operational 
needs of the Counterterrorism Division (CTD) and all other IDW 
users . 

Reference: 66F-HQ-1321794 Serial 194 

operational need to apply the advanced 
features of the IDW system across a broader set of data By 
adding these additional data sources, CTD will be able to uncover 

reLlti"'i??T' links and activities. The enhanced 

results will contribute significantly to the FBI counterterrorism 


, , ISPG has reviewed the data approval recruests and 

relevant Office of General Counsel (OGC) privacy 
interests of all operational divisions and 
pecific records management issues have been addressed. The ISPG 


be 

b7C 


be 

b7C 





To: Office of the CIO From: Directorate of Intelligence 

Re: 66F-HQ-C1434337, 03/25/2005 ^ 


approves the immediate addition of the following seven (7) data 
sets with appropriate updates for use in IDW/SPT. 



bv cm sources are currently owned and licensed 

vJifSnS for CT work. Data quality and currency is not 

alidated prior or during system loading. Newer editions of the 
sources will be loaded and the older editions will continue to be 


2 





To: 
Re : 


Office of the CIO From: Directorate of Intelligence 

66F-HQ-C1434337, 03/25/2005 utixxxgence 


part of the IDW/SPT analyses 
retrospective analysis. 


Retention of older data permits 


Technical implementation may be either as an adjunct 
system accessible through IDW/SPT or as an integral part of the 
^derlying, searchable federated data stores of IDW/SPT. This 
data approval does not obligate funds or resources for the 
technical activities that are required to implement and support 
system loading and related activities. 

Management Division (rmd) will provide guidance 
for specific retention, disposal, and archiving 

for this data and the results of analysis derived from this data^ 
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To: Office of the CIO From: Directorate of Intelligence 

Re: 66F-HQ-C1434337, 03/25/2005 


L£AD(s) : 


Set Lead 1: (Action) 

RECORDS MANAGEMENT 

AT WASHINGTON. DP 

Provide guidance to IDW/SPT concerning specific 
retention, disposal, and archiving for the data and results of 
analysis derived from the data. 

Set Lead 2 : (Info) 

COUNTERTERRORISM 

AT WASHINGTON, nr 

Read and clear. 

Set Lead 3; (Info) 

DIRECTOR'S OFFICE 

AT CIO. DC 

Read and clear. 


♦♦ 
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Page 1 of 3 


THOMAS, MARCUS C. (OTD) (FBI) 


ALL INFORMATIOH COMTAIHED 

HEREIKT IS UHCLAS3IFIED 

DATE 08-27-2007 BY 65179 DMH/BJA/CAL 

1058805 


Cc: 


rOivOO) (FBI) 


From: 

Sent: Thursday, April 29, 2004 2:14 PM 

I 

To: 


(UivOO)(FB ni "" 

I lrDiv05 )(FBI):l 

(FBI);| _ "T 




DivOO) (FBH: f 


KDivOOl fF| h[ 


(NY)(FBI)1; 




tPivlTI (FBI 




] 


iFBiir 


MY.QQ) (FBI);l 


tPivOO) ( FBh: 

Isi 




DivOQI (F BO: [ 


t)IV001 (FBI): r , 

ivOI) (FB m IDivOOl ( FBIV 

(DivOO) (FBI)j TDivU ) 

iDivQOI (FBIVI I 

bivOO) (FBI); 



(DivOO) (FBI)£ 


iDivOO) (FBI): L 


IpvOOHFBi)ir 

~rDiv05)(FBI)r 




J (DivOO) (FBI)|_ 


I 


(DivOO) (FBI);| 

JONATHAN L (MM) (FBI); BERI^ 
(FBI); WEIS, J P. (DIVOO) (FBI); 


IfDivOO) (FBI): 

|(Div16) (FBI); SOLOMON, 

:I$1N .IFFFRFY.I miYl1)(FBI);| 

IDivOO) 

;l KU1V06) (FB1);| | 1 


1C 


(FBliJ 


jDivOO) (FBI); 


IdIvOO) (FBI);' 


i(DivOO) (FBI); 

IfDivOO) (FBI): HA YNES. KER RY E. (ER ) (OGA); 


JDivOO) (FBI)" 


DivOO) (F BI): I 

rPivOO) (FBI) 


IFBUE 




UDivoe) (fbi)( 


DivOO) (FBI): QUIJAS, LOUIS F. (DivOO) (FBI): 
’DivOO) (FRiv I ^ ivnn^ 

T PivOS) (FBI):I 


(DivOO) (FBI);t 


(PivOS) (FBI): 


c 


(CK) (FBI); I 


1(OM) (FBI): 


InOHFBI); 


(DIV OO) (FBI):f 
(FBI) 


- KUr 


(DivOO) (FBI); DELANCER, MAXIMO M. (Div06) (FBI): 

rPivOO V 


jyPINA, MICHELLE ANN (DivOO) 
(ER) (FBI); | I 

DivOO) (FBlil I 


DivOO) (FBI)t 




tPivOO) (FBI)lf 


jDiv17) (FBI);! 


KELLEY. PATRIC K \A/. (Div09) (FBI) I — --nm ivin) r FRh l I 

iDivOO) (FBI); COFFEY, ROB ERT CARL (DivOO) (FBI)7 l (DivOO) 


JDivOO) 

I 


(FBI); GARRITY, ROBERT J . JR(Div17) (FBIvr 
ROBERT S. Ill (DivOO) (FBI);[ 


X 


lDiv14) (FBI); MUELLER, 
JDivOO) (FBI); 


(DivOO) (FBI);! 

(FBI); BERE ZNAY. TIM OTHY D. (DivOS) ( FBI): HARRIN GTON. T J. (biv13) fFRI 


]D0 Security Detai l: MARTINE Z. STEVEN 

pivOO) (FBl i fP ivOO) 


l| nivOO) (pi)i 

(DivOO) (FB I) I 


j(Div12) (FBI); 


1 


1 


J(DivOO ) (FBI); 


DivOO) (FBI); BOLL INGER. VIRGINIA L. (DivOs) (FbI);L 

rPivOO) (FBI): H OOTON. WILLIAM L. (Div17) (FBI);C 


1 


]DivOO) (FBI); AZMI, ZALMAI (DivOO)' (OGA); 


JMUEL LER. ROBERT S. Ill (DivOO) (FBI); CASTOR, ANDREW J. (SA) (FBI) 
]^(DivOO) (FBI);[ 


1(DivOO) (FBI)C 


J(IRD) (FBI): 


I(Div04) (FBI);1 l(Div04) (FBI); HOBSO N. PAMELA M. 

(DivQ4) (FBI)! |(Div04) (FBI)j l: Div04) (FBI); 

](Div04) (FBI): i l(rp ivn4WFRl)| — 


(Div04) (FBI); G EORGE. NICK L. (Div04) (FB hf 
N. (Div04l (FBnl ICDi' 

I l(Div(J4)(mi):l 


Si 


(Div04) (FBI); JOLMA, LAWRENCE 
(Div04) (FBI); LUCC HESI. CARL p L (Div04} (FBI); 


](Div04) (FBI)C 


] (Div04) (FBIT 


, , l (Div04) (FBI); | 

I , EExSinEHnrv^NER, JOHN j. (Div04) (FBIll 

(FBI)I |i;Div04l (FBnr 


jDiv04) (FBH-P^ 


J (Div04) (FBI)i 


343 (FBI; 
'Piv04) 


](Div04) (FBI) 


}Div04)(FBl£ 


niMiEii 




lDiv04l 


]Divd4) (FBI); 


be 

b7C 


be 

b7C 


be 

b7C 


be 

b7C 


be 

b7C 


10/27/2006 






10/27/2006 



Message 


Page 3 of 3 


On Januaty 25, 20 04, IDW 1 .0 was successfully deployed pro\dding users with access to CT/CI 
ECF and UNI data, | [ Intel Plus file rooms. SAMNET. JICI scanned CT document s, open 

source news, and VGTOF using th j b nd b2 

retrieval tools. Training was deployed throughout the field for Field Intelligence Group 
personnel. To date, 485 accounts have been issued and CounterTerrorism Division has plans to 
request 4,200 accounts for members of the Joint Terrorism Task Force members through the 
field. The IDW-Integration environment was established and is ready for final security testing. 


OTHER 0/S 


OTHER 0/S 


SENSITIVE BUT UNCJ^S^ 


10/27/2006 
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HEREIN IS UNCLASSIFIED 

DATE 01-07-2008 BY 65179 DHH/BCtA/CAL 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse Integration System (IDW-I) 

System Security Plan 

.79 DHH/BctA/CAL . . 22 April 04 

! ' Version 0.5 


Federal Bureau of Investigation 
Information Resources Division 
Data and Information Management Section 



Investigative Data Warehouse Integration 

System (ID W-I) 

System Security Plan 

Document Version 0.6 
22 April 04 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 






:iAL USE ONLY 

Warehouse Integration System (BDW-I) 
System Security Plan 
22 April 04 

Version 0.5 


h2 

blE 


[Sets 


:al use only 


Outside the Scope 




















UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse Integration System (IDW-I) 

System Security Plan 
03 NOV 04 

• Version 1.0 


F EDERAL Bureau of Investigation 
Information Resources Division 
Data and Information Management Section 



System (IDW-I) 
System Security Plan 


ALL IMFOFHATIOJI COMTAIHED 

HEREIN IS UNCLASSIFIED 

DATE 01-07-2008 BY 65179 DHH/BJA/CAL 


Document Version 1.0 
03 November 2004 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 






UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse Integration System (IDW-I) 

System Security Plan 


03 NOV 04 
Version 1.0 



llllllill 

liBiPPli 


ACS 

Electronic 
Case Files 
(ECF) 

FBI Automated 
Case System 
(ACS) 

Secret and below 


IntelPlus 

Filerooms 

FBI IntelPlus 

Secret and below 


SAMNet 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 


VGTOF 

FBI National 
Crime Information 
Center (NCIC) 

SBU 


JICI 

FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 

Secret and below 


Open 

Source 

News 

MiTAP 

Unclassified 



Table 3.5.1 IDW-I Data Sets 


b2 

b7E 


-15- 

UNCLASSIFIED // FOR OFFICIAL USE ONLY 












UNCLASSIFIED//FOR OFFICIAL USE ONLY 


F EDERAL Bureau of Investigation 
Office of tbde Program Management Executive 


ALL lETFORHATIOM COOTAIHED 
HEREIN IS UNCLASSIFIED 
DATE 01-07-2008 BY 6S179 DUH/BJAyCAL 

Security Concept of Operations (S-CONOPS) 
Investigative Data Warehonse (IDW) Program 

Document Version 1.2 


November 29, 2004 



i 

UNCLASSIFIED//FOR OFFICIAL USE ONLY 


UNCLASSIFIED//FOR OFFICIAL USE ONLY 


Outside the Scope 


The table below lists the data and sources for the Operational Subsystem. 




<mi£^Bf8MrSf5S 

ACS 

Electronic 
Case Files 
(ECF) 

FBI Automated 
Case Support 
(ACS) 

Secret and below 

IntelPlus 

Filerooms 

FBI IntelPlus 

Secret and below 

SAMNet 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 

VGTOF 

FBI National 
Crime Information 
Center (NCIC) 

SBU 

JICI 

FBI Records 
Management 
Division (RMD), 
Dociunent 
Laboratory 
(DocLab), FBIHQ 

Secret and below 

Open 

Source 

News 

MiTAP 

Unclassified 


Operational Subsystem Data Sources 


The data flow begins at the external data sources. These som 
databases including ACS, SAMNET, Intelplus and several others 


tclude various FBI 


b2 

b7E 
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XJNCLASSIFIED//FOR OFFICIAL USE ONLY 


Outside the Scope 



2.3.2 Special Projects Team (SPT) Subsystem 

The Special Projects Team (SPT) Subsystem allows for the rapid import of new specialized 
data sources. These data sources are not made available to the general IDW users but instead are 
provided to a small group of users who have a demonstrated “need-to-know”. The SPT System 
is similar in function to the IDW-S system, with the main difference is a different set of data 
sources. The SPT System allows it’s users to access not only the standard EDW Data Store but 
the specialized SPT Data Store. 

The table below lists the data and sources for the SPT Subsystem. 


UNCLASSIFIED//FOR OFFICIAL USE ONLY 



XJNCLASSIFIED//FOR OFFICIAL USE ONLY 



(B^ssaissi 


FBI Case 
Data 

FBI Automated 
Case System 
(ACS) 

Secret and below 

Financial 

Center 

(FinCen) 

Data 



SBU 

Various 
Lists of 
Data 

Various Sources, 
e.g., 

Transportation 

Security 

Administration 

(TSA) 

SBU 

Various 

CTD 

Datasets 

FBI 

Counterterrorism 
Division (CTD) 

Secret and below 

Telephone 

Data 

Database of 
telephone 
numbers from 
ACS indexed by 
phone number, 
names, addresses, 
and case numbers 

Secret and below 


SPT Data ^ 


■Outside the Scope 
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ACS 

Electronic 
Case Files 
(ECF) 


IntelPlus 

Filerooms 


SAMNet 


VGTOF 




FBI Automated 
Case System 
(ACS) 



FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 




FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 


Unclassified 
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ID W-S VI. 0 Data Migration Plan 


September 30, 2003 


All lUFORHATIOH COHTAIHEIi 
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DATE 01-07-2008 BY 6S179 DUH/BJA/CAl 
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! 

! 


SCOPE V2. 0/ID W VI. 0 Data Sets 


ACS ECF (CT Case Files): 

♦ ASCn flat files (metadata ^id document text) and WordPe rfect (document) binaries 

♦ I 

♦ Data is synchronized once a day, which includes processing of adds, deletes, and modifications 
Intelplus (CT Filerooms): 

♦ Scanned HFF images and OCR’ed ASCII text documents 


♦ Data is synchronized once a week, which includes processing of adds, deletes, and modifications 
SAMnet: 


♦ ASCn files in standard cable traffic message format (all cap itals with specific header) 


♦ SAMNET data is provided/updated three times a day 

JICI: 

♦ Scanned TIFF images and OCR’ed ASCII text (pages) 


h2 

hlZ 


♦ Static file system ~~ 

VGTOF: 

♦ ASCn flat files (data/metadata, one row per subject) and JPEG im age binaries (none, one, or multiple per subject) 


♦ At present, updated file being provided in its entirety on a weekly basis 

Open Source: 

♦ The Open Source Library is collected fi-om global news sources that are either in English or have been translated 

into English 


♦ The Open Source Library is updated once a day 
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Version: 0.6 
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Investigative Data Warehouse (IDW> - Secret 
System Security Plan 

INTRODUCTION 


The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an 
initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated 
data previously only available through individual applications. The IDW-S system will be 
authorized to process classified national security data up to, and including. Secret. The 
IDW-S system is the successor of the Secure Counter-Terrorism/Collaboration Operational 
Prototype Environment (SCOPE”). 


'Outside the Scope 


Data processed by the system will include the following data sets: 

• Approved case files fi-om the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation 
(JICI) defined archived documents; 

— . 
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• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPIus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the 
Criminal Justice Information Systems (CJIS) Division; 


• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open 
Source Data 
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Data Sources 

IDW-S contains data from the following data sources with security classification indicated 
in brackets: 

• Automated Case Support (ACS) System, Electronic Case File (ECF) 

Subsystem [Secret and below] 

• fritelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and 
below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DAKPA/nDES Open Source News [Unclassified] 

Data from each source is held in an identified source Library against which users can direct 
the analytical tools. 

Data Ingest 


IDW-S receives data from sources by FTP over FBINet [ACS ECF. TntfilPliis. and 

] Deleted: SAMNet 



• Data is received by the Ingest Subsystem 


• 1 1 

Outside the Scope 

- Received data is parsed into individual serial records (in the case of ACS 
ECF), documents (IntelPlus, JICI, Open Source News), messages 
(SAMNet), or files (VGTOF). 

1 " 
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Outside the Scope 


3.5. Data Processed 

IDW-S processes the following data: 

3.5.1 ACSECF 

IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the 
Automated Case System (ACS). This subset consists of serials in those case 
classifications/sub classifications that have been officially sanctioned for inclusion 
in IDW. For each such serial, the ECF data includes metadata and text. IDW-S is 
synchronized against the ECF system once a day, a process which consists of 

receiving and pro cessing the previous day’s increment of ADD. MOD, and 

DELETE records.! I 


3.5.2 latelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (Cl) Filerooms: 


■Outside the Scope 
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3.5.3 SAMNet 


The Secure Automated Messaging Netvyork (SAMNet) data source consists of ca ble 
traffic messages received by the FBl!| 

I SAMNet provides only ADD record 

types, and SAMNet data is updated in IDW-S three times a day. SAMNet data is 


3.5.4 VGTOF 


Violent Gang Terrorist Oflfender File (VGTOF) data is provided by the FBI 
National Crime Information Center (NCIC). VGTOF data includes two 
components: Data/metadata for each named individual/offender and potentiall-v 
multiple JPEG images per individual.! 
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3.5.5 JICI 

The Joint Intelligence Conunittee Investigation (JICI) data collection was created following 
the September 11 attacks. Paper counter-terrorism files/foldets from all FBI Field Offices 


is not updatedJ 


I JICI is a static collection that 


3.5.6 Open Source News 

The IDW-S VI .0 system contains an Open Source News library collected by the 
DARPA TIDES Program. These are primarily news source fiom around the world 
that are either in English or have been translated into English. Op en Source News 
data is re ived in the form of text files (one per news article) and ] 

I tl he Open Source News data goes into IDW-S once a day. Open Source 

News data ~~ 

Open Source News material is derived from the following sources: 

Addis Ababa Tribune - http.V/www.addistribune.com/ 

Agenda Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 

AJlAfiica.com - http://allafnca.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://wvw.atimes.com/ 

Bangkok Post - http://wvw.bangkokpost.net/ 

.Christian Science Monitor - http://vww.csmonitor.com/ 

Crescent International - http://vww.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://wvw.debka.com 

East Africa Daily Nation - wvw.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://vww.gulf-news.com/ 

Ha’aretz (Israel) - http://wvw.haaretzdaily.com/ 
iFRC international Federation 

IRIN Litegrated Regional information Network - http://vww.irim^ 

Iraq Press News Agency - http^/www.iraqpress.org/ 


Deleted: Intemation 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 


Investigative Data Warehouse (IDW) - Secret 
System Security Plan 
3.December 2003 
Version 0.6 


Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapostcom/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - www.vatican.va/news_services/or/or_eng/texthtml 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.cora.pk/ 

Lebanon Daily Star (Beirut) - http://www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 
PETRA (Jordanian News Agency) - http://www.petra.gov.Jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://www.philstar.com/philstar/ 

Pravda - httpV/english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - http://www.smh.com.au 
Tehran Times - http://www.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 
UNHCR UN High Commissioner on Refugees - http://www.unhcr.ch/ 

Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 

Washington Post - http://www.washingtonpost.com/ 

XinHua News Service - http://www.xinhuaneLcom/english/ 

Yemen Times (weekly) - http://www.yementiraes.com/ 

Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ 
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3.5.7 Summary of Data Sources 




tStKiiOiS® 

ACS 

FBI Automated Case 
System (ACS) 

FTP 

InfelPlus 

FBI Intel Plus 

FTP 

SAMNet 

FBI Secure Automated 
Messaging Network 
(SAMNet) 

FTP 

VGTOF 

FBI National Crime 
Information Center (NCIC) 

CD-ROM 

Jia 

FBI Records Management 
Division (RMD), 
Document Laboratory 
(DocLab), FBIHQ 

Multiple 

Open 

Source 

News 

Translingual Information 
Detection, Extraction and 
Summarization (TIDES) 
Program, Defense Advanced 
Research Projects Agency 
(DARPA) 

CD-ROM ’ 
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3.9.9 Indirect Connections Outside the Scope 

LDW-S connects lo the following sources of dala: 






1 

FBI Aubinialcrl 
Case .Svstem CACSI 

Scerct 

mi 

FTP 


1451 Intel Plus 

Secret 

FBI 

FTP 


b2 

b7E 
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FBI Secure 
Automated 
Messasinu Network 
(SAMNcA 

Secret 


FTP 


FBI National Crime. 
Information Center 
CNCJCl 

^■1 

FBI 

CD-ROM 


FBI Document 

Conversion 

Labomlon' 

CDocI.ah'l. Records 

MiUingemenl 

Division (RMDV 

FBIIIO 

Secret 

FBI 

Multinie 


rranslinaiml 
Information Deteclioi 
EMraction and 
Summarization 
tTIDES) Proaram. 
Defense Advanced 
Rcsciuci) Proiecis 
Aeenev tD-ARPAt 1 

Unclassified 

NA 

CD-ROM 
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INVESTIGATIVE DATA WAREHOUSE 



III 


- SECRET 


SYSTEM SECURITY PT. AN 


INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an initial 
data warehouse, content management and data mining system that will permit FBI investigative, 
analytical, administrative and intelligence personnel to access aggregated data previously only 
available through individual applications. The IDW-S system will be authorized to process 
classified national security data up to, and including. Secret. The IDW-S system is the successor 
of the Secure Counter-Terrorism/Collaboration Operational Prototype Environment (SCOPE” 



Data processed by the system will include the following data sets: outside the scope 

• Approved case files from the FBI’s Automated Case Support (ACS) case man?;g(»r ne nt 
system; 

• Electronic versions of the Joint lotelligence Committee Investigation (JICI) defined 
archived documents; 

• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; and 
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Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal Justice 
Information Systems (CJIS) Division; 

Defense Advanced Research Projects Agency (DARPA) Translingual Information 
Detection, Extraction and Summarization (TIDES j Onen Source Data 



DRAFT 


SAIC-STD-IDW.S 1.0 v0,6 


^ EDERAL Bureau of Investigation 

Information Resources Division 
Data/Information Management Section 



Test & Evaluation System Test Description (TESTD) 
for the Investigative Data Warehouse (IDW) v.1.0-8 


ALL IIJFOKttATIOH CONTAINED 

HEREIN IS UNCLASSIFIED 

DATE 01-07-2008 BT 6S179 DHH/BJA/CAL 


October 2003 


Prepared by: 

Science Applications International Corporation 
1213 Jefferson Davis Highway, Suite 1200 
Arlington, Virginia 22202 



An Bmployee-Owned Company 


Draff FBI IDW System Test Descnption iDW1.0-v0.8Moc 




DRAFT 


SAIC-STD-IDW-S 1.0 vO.6 



Science Applications International Corporation (SAIC) 
Draft FBI IDWSystem Test Description IDWI.O-vO.e.doc 



TEMP-IDW-S vO 


DRAFT 


ALL INFORMATION CONTAINED 
DRAFT HEREIN IS UNCLASSIFIED 

DATE 01-07-2008 BY 65179 DHH/BJA/CAL 


^ EDERAL OUREAU OF INVESTIGATION 

Information Resources Division 
Data/Information Management Section 



Test & Evaluation Master Plan (TEMP) 
for the Investigative Data Warehouse (IDW) 


October 2003 


Prepared by: 


Science Applications International Corporation 
1213 Jefferson Davis Highway, Suite 1200 
Arlington, Virginia 22202 


An Ewployee-Ovmed Company 


Draft FBI IDW-S Test & Evaluation Master Plan vO.dac 
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System Security Plan 

Investigative Data Warehouse-SECRET 

(IDW-S) 
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Version: 0.7 
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Federal Bureau of Investigation (FBI), 
Information Resources Division (IRD) 
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Investigative Data Warehouse (IDW^ - Secret 
System Security Plan 

INTRODUCTION 


The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an initial 
data warehouse, content management and data mining system that will permit FBI investigative, 
analytical, administrative and intelligence personnel to access aggregated data previously only 
available through individual applications. The IDW-S system will be authorized to process 
classified national security data up to, and including, Secret llie IDW-S system is the successor 
of the Secure Counter-Terrorism/Collaboration Operational Prototype Environment (SCOPE”). 


Outside the Scope 


Data processed by the system will include the following data sets: 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 

• Secure Automated Messaging Network (SAMNet) message traffic; 
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• IntelPlus File Rooms; and 

• Violent Gang and Tenorist Organization File (VGTOF”) from the Criminal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency PARPA) Translingual 
^formation Detection, Extraction and Summarization (TIDES) Open Source 


Outside the Scope 
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• Automated Case Support (ACS) System, Electronic Case File (ECF) Subsystem 
[Secret and below] 

• IntelPIus [Secret and below] 

• Secure Automated Message Network — Secret (SAMNet-S) [Secret and below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DARP A/TIDES Open Source News [Unclassified] 

Data from each source is held in an identified source Library against which users can direct the 
analytical tools. 

Data Ingest 



Received data is parsed into individual serial records (in the case of ACS 
ECF), documents (IntelPIus, JICI, Open Source News), messages (SAMNet), 
or files (VGTOF). 
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have been officially sanctioned for inclusion In BDW. For each such serial, the ECF data includes 
metadata and text. IDW-S is synchronized against the ECF system once a day, a process which 
consist s of receiving and processing the previous day’s increment of ADD. MOD, and DELETE 
records/ — 


3.5.2 IntelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms; 


Outside the Scope 



b2 

b7E 


3.5.3 SAMNet 


The Secure Automated Messaging Network (SAMNet) data source consists of cable traffic 
messages received by the FBlf 


I iSAMNet provides only ADD record types, and SAMNet data is updated in IDW-S thrU 

times a day. SAMNet data i| 


b2 

b7E 
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3.5.4 VGTOF 

Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI National Crime 
Information Center (NCIC). VGTOF data includes two components; Data/metadata for each 
named individual/offender and potentially multiple JPEG images per individual^ 


3.5.5 JICI 

The Joint Intelligence Committee Investigation (JICI) data collection was created following the 
September 11 attacks. Paper counter-terrorism files/folders from all FBI Field Offices! 


/ JlCl is a static collection that is not updated.! 

3 

3.5.6 Open Source News 

The IDW-S VI. 0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source News data is received in the form of text files 
(one per news article) an j hOie Open Source News data goes into I DW-S 

once a day. Open Source News dat j | 

Open Source News material is derived from the following sources: 

Addis Ababa Tribune - http://www.addistribune.com/ 

Agenda Brasilia - httpWwww.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 

AllAfnca.com - http://allafrica.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://\vww.atimes.com/ 

Bangkok Post - http.V/wvw.bangkokpostnet/ 

Christian Science Monitor - http://www.csmonitor.com/ 
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Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - httpy/www.haaretzdaily.com/ 

IFRC International Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 

Iraq Press News Agency - http://www.iraqpress.org/ 

Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapostcom/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - www.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://wrww.miami.com/ 

Moscow Times - http://wrwrw.themoscowtimes.com/ 

National Post and CP - http://wwrw.canada.com/ 

New Straits Times (Kuala Lumpur) - http://wwrw.emedia.com.my/Current_News/NST/ 

PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://wrwrw.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.tussianobserver.com/ 

SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://wwrw.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - http://wwrw.smh.com.au 
Tehran Times - http://www,tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 

UNHCR UN High Commissioner on Refugees - http://wrwrw.unhcr.ch/ 
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Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - ht^://www.uzreport.com/eng/ 
Washington Post - http://www.washingtonpost.com/ 
XinHua News Service - http://www,xinhuaneLcom/english/ 
Yemen Times (weekly) - http://www.yementimes.com/ 
Yomiuri Shimbun (Japan) - httpV/www.yomiuri.co.jp/ 

3.5.7 Summary of Data Sources 
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3.9.9 Indirect Connections Outside the Scope 


IDW-S connects to the following sources of data; 
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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse Secret System (IDW- 
S) is an initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated data 
previously only available through individual applications. The IDW-S system will be authorized 
to process classified national security data up to, and including. Secret The IDW-S system is the 
sucressor to the Secure Collaboration Operational Prototype Environment (SCOPE), which 
originally was named the Secure Counter-Terrorism Operational Prototype Environment. 


Data processed by the system will include the following data sets: 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 


Outside the Scope 
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• Secure Automated Messaging Networic (SAMNet) message traffic; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
Data 
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3.5. Data Processed 


IDW-S processes data from the followins data sources, with the security classification of the 
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Data Sourc« w/Tranafer Mechanism 

3.5.1 ACSECF 

IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the Automated Case 
System (ACS). This subset consists of serials in those case classifications/sub classifications that 
have been officially sanctioned for inclusion in EDW-S. For each such serial, the ECF data 
includes metadata and text. IDW-S is synchronized against the ECF system once a day, a process 
which consists of receiving and processing the previous day’s increment of ADD. MOD, and 
DELETE records] 
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3.5.2 IntelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 
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3.5.3 SAMNet 


The Secure Automated Messaging Network (SAMNet) data source consists of cable traffic 
messages received by the FBI 

\^AkNet provides only ADD record types, and SAMNet data is undated in TDW-S i 


3.5.4 VGTOF 

Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI National Crime 
Information Center (NCIC). VGTOF data includes two components: Data/metadata for each 

named individual/offender and p otentially multiple IPEG images per individual. The 

data/metadata for each individua/ 


3.5.5 JICI 

The Joint Intelligence Committee Investigation (JICI) data collection was created following the 
September 11 attacks. Paper counter-terrorism files/folders from all FBI Field Office^' 
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JICI is a static collection that is not updated! 1 

3.5.6 Open Source News 

The IDW-S VI .0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source News data is received in the form of text files 
(one per news articl j I The Open Source News data goes into IDW-S 

once a day. Open Source News dati j | 

T b7E 
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1/5/2004 4:33 PM 


Page 26: [1] Deleted Neil Gerr 

Open Source News material is derived from the following sources: 

Addis Ababa Tribune - ht^://www.addistribune.com/ 

Agencia Brasilia - ht^;//www.radiobras.gov.br/ 

AI-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 
AllAfrica.com - http://allafrica.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://www.atimes.com/ 

Bangkok Post - http://www.bangkokpost.net/ 

Christian Science Monitor - http://www.csmonitor.com/ 

Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - ht4)://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaret 2 xlaily.com/ 

IFRC International Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 

Iraq Press News Agency - http://www.iraqpress.org/ 

Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejikartapost.com/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - www.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - ht^://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 
PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://www.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 


SABA (The News Agency of Yemen) - htQ)://www.sabanews.gov.ye 
Saudi Gazette - ht^://www.saudigazette.com.sa/sgazette/ 

South Afiican Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - htfp://www.smh.com.au 
Tehran Times - htQ)://www.tehrantimes.com/ 

Times of India - http://timesofindia.mdiatimes.com/cms.dll 
UNHCR UN High Commissioner on Refugees - http://www.unhcr.ch/ 
Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 

Washington Post - http://www.washingtonpost.com/ 

XinHua News Service - http://www.xmhuanet.com/english/ 

Yemen Times (weekly) - http://www.yementimes.com/ 

Yomiuri Shimbim (Japan) - http://www.yomiuri.co.jp/ 
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1.2.2 Supported Projects 

IDW-S is an FBI enterprise program/system and utilizes data feeds from several FBI (and other 
agency) programs. 
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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse Secret System (IDW- 
S) is an initial data warehouse, content management and data minin g system that will permit FBI 
investigative, analjdical, adrnmistrative and intelligence personnel to access aggregated data 
previously only available through individual applications. The IDW-S system will be authorized 
to process classified national security data up to, and including. Secret. The EDW-S system is the 
successor to the Secure Collaboration Operational Prototype Environment (SCOPE), which 
originally was named the Secure Counter-Terrorism Operational Prototype Environment. 



Data processed by the system will include the following data sets; 
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• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 





UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse (IDW) - Secret 
. System Security Plan 
16 Januaiy 04 

^ Version 1.0 


• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF) firom the Criminal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
Data 
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1.2.2 Supported Projects 

IDW-S is an FBI enterprise program/system and utilizes data feeds from several FBI (and other 
agency) programs. 
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3.5. Data Processed 

ID W-S processes data &om the following data sources, with the security classification of the 
source indicated in brackets: 

• Automated Case Support (ACS) System, Electronic Case File (ECF) Subsystem 
[Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 

TT 1 _ JT 


Unclassified] 

Joint Intelligence Committee Investigation (JICI) [Secret and below] 
DARPA/TIDES Open Source News [Unclassified] ° 
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Data Sources w/Transfer Mechanism 


3.5.1 ACSECF 


IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the Automated Case 
System (ACS). This subset consists of serials in those case classtfications/sub classifications that 
have been officially sanctioned for inclusion in IDW-S. For each such serial, the ECF data 
includes metadata and text. IDW-S is synchronized against the ECF system once a day, a process 
which consists of receiving and processing the previous day’s increment of ADD, MOD, and 
DELETE records! 1 



3.5.2 IntelPlus 
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IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 
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3.5.3 SAMNet 


The Secure Automated Mess aging Network tSAMNet^ data source consists of cable traffic 
messages received by the FBIA 

i SAMNet provide s only ADD record types, and SAMNet data is updated in EDW-S thrU 
times a day. SAMNet dat 


3.5.4 VGTOF 


Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI National Crime 
Information Center (NCIC). VGTOF data includes two components; Data/metadata for each 
named individual/offender and potentially multiple JPEG images per individual.! 
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3.5.5 JICI 


JICI is a static collection that is not updated.V 
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3.5.6 Open Source Nevj^s 

The IDW-S VI .0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source N ews data is received in the form of text files 
(one per news article] fPhe O pen Source News data goes into IDW-S 

once a day. Open Source Mews data i] | 
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IDW-S connects to the following sources of data: 
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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse Secret System (IDW- 
S) is an initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated data 
previously only available through individual applications. The K>W-S system will be authorized 
to process classified national security data up to, and including. Secret. The IDW-S system is the 
successor to the Secure Collaboration Operational Prototype Environment (SCOPE), which 
originally was named the Secure Counter-Terrorism Operational Prototype Environment. 



Data processed by the system will include the following data sets: 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICl) 
defined archived documents; 
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• Secure Automated Messaging Network (S AMNet) message traflBc; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal 
Justice Information Systems (CJIS) Division; 


• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
Data 
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• Automated Case Support (ACS) System, Electronic Case File (ECF) Subsystem 
[Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DARP A/TIDES Open Source News [Unclassified] 

Data from each source is held in an identified source Library against which users can direct the 
analytical tools. 

^ata Ingest | 


IDW-S receives data from sources by F TP over FBINet (ACS ECF, IntelPlus, and S AMNet) and 
CD-ROM (VGTOF. Open Source Newsll I 


Data is received by the Ingest Subsystem 



Received data is parsed into individual serial records (in the case of ACS 
ECF), documents (IntelPlus, JICI, Open Source News), messages (SAMNet), 
or files (VGTOF). 
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3 . 5 . Data Processed 

IDW-S processes the following data: 

3.5.1 ACS ECF 

IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the Automated Case 
System (ACS). This subset consists of serials in those case classifications/sub classifications that 
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have been officially sanctioned for inclusion in DDW-S. For each such serial, the ECF data 
includes metadata and text. IDW-S is synchronized against the ECF system once a day, a process 
which consists of receiving and processing the previous day’s increment of ADD, MOD, and 
DELETE records.! I 


3.5.2 IntelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 
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3.5.3 SAMNet 

The Secure Automated Mess aging Network (SAMNet) data source consists of cable traffic 
messages received by the FBI.l ~~ 


I SAMNet provides only ADD record types, and SAMNet data is updated in IDW-S three 
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Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaretzdaily.com/ 

IFRC International Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 

Iraq Press News Agency - http://vww.iraqpress.org/ 

Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://wvnv.thejakairtapostcom/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - wrww.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://wrww.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://wwrw.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://wwrw.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://wwrw.mb.com.ph/ 

Manila Times - http://wrwrw.manilatimes.net/ 

Miami Herald - http://wrwrw.miami.com/ 

Moscow Times - http://wrww.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/CuiTent_News/NST/ 

PETRA (Jordanian News Agency) - http://www.petra.gov.Jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopIedaily.com.cn/ 

Philippine Star - http://wrww.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 
Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://wrww.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://wrww.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://wrv/w.dispatch.co.za/ 

Sydney Morning Herald - http://wrwrw.snih.com.au 
Tehran Times - http://wwrw.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 

UNHCR UN High Commissioner on Refugees - http://wwrw.unhcr.ch/ 
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Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 
Washington Post - http://www.washingtonpost.com/ 
XinHua News Service - http.V/www.xinhuaneLcom/english/ 
Yemen Times (weekly) - http://www.yementimes.com/ 
Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ [ 

3.5.7 Summary of {Data Sources! 
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1 introduction 
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management system; 
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1.4. 1.1 Data Sources out s id 

The FBI maintains large databases of records. These records are recorded in both standard and 
vendor/developer unique formats. ~ 
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Data processed by the system includes the following sources: 

• Approved case files fiom the FBI’s Automated Case Support (ACS) management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) defined 
archived documents; 

• Secure Automated Messaging Network (SAMNet) message trafBc; 

• IntelPlus (INTEL+) File Rooms; 
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Operational Subsystem Data Sources 

The data flow begins at the external data sources. These sources include various FBI 
databases including ACS, SAMNET, Ihtelplus and several others.! 
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2.3.2 Special Projects Team (SPT) Subsystem 

The Special Projects Team (SPT) Subsystem allows for the rapid import of new specialized 
data sources. These data sources are not made available to the general IDW users but instead are 
provided to a small group of users who have a demonstrated “need-to-know”. The SPT System 
is similar in function to the IDW-S system. With the main difference is a different set of data 
sources. The SPT System allows it’s users to access not only the standard IDW Data Store but 
the specialized SPT Data Store. 

The table below lists the data and sources for the SPT Subsystem. 
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